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ABSTRACT 
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Grouped Active Teach ing_ (AGATl; a group-paced model, the Missouri 
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while the second experiment was conducted with pupils in grades 3-5. 
Nested analysis of variance on CTBS Computations scores adjusted for 
pretests indicated that in both experiments, TAI and AGAT exceeded 
MMP. In Experiment 2, TAI t AGAT, and MMP also exceeded control. No 
interactions with prior achievement were found . Effects on Liking of 
Math Class and (in Experiment i) Self-Concept in Math favored TAI. 
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Introductory Statement 



.. j 

The Center for Social Organization of Schools (CSOS) has two primary 
objectives: to develop a scientific knowledge of how schools affect /their 
?t uc *P n ? s i_ anc * to use this knowledge to develop better school practices arid 
organization. 

The Center works through three research programs to acl ieve it$ 
objectives: 

The School Organization Program investigates how school and classroom 
organization affects student learning and other immediate outcomes^ of schooling 
Current studies focus on parental involvement, microcomputers in schools 3 
use of time in schools, cooperative learning, and other organizational 
strategies that alter the task, reward, authority and peer group /structures in 
schools and classrooms. 

The Education and Work Program examines the relationship between 
schooling and students' later-life occupational and educational/ successes . 
Current projects include studies of the competencies required in the workplace, 
the sources of training and experience that lead to employment / college 
students 1 major field choices, and employment of urban minority youth. 

The Schools and Delinquency Program studies the problems/ of crime - 9 
violence;, vandalism, and disorder in schools and the role that schools play 
in delinquency. Ongoing projects address the development of a theory of 
delinquent behavior, school effects on delinquency , and the ^evaluation of 
delinquency prevention programs in arid but of schools. 

CSOS also supports a Fellowships iri Education Research program that 
provides opportunities f o r talented researchers to conduct' and publish 
significant research in conjunction with the three research programs . 

This report, prepared by the School Organization Program, presents 
results of two randomized field experiments that compared the effects on 
students of three types of instructional processes . 



ii 
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ABSTRACT 



This research evaluated mathematics achievement and attitudinal 
effects of three instructional methods directed in varying degrees toward 
accomodating diversity in students' prior achievement • Two randomized 
field experiments of 16 and 18 weeks' duration, respectively, compared 
ail individualized model, Team Assisted Individualization (TAI) ; an ability 
grouped model, Ability Grouped Active Teaching. (AGAT) ; a group-paced model, 
the Missouri Mathematics Program (MMP); and, in Experiment 2 only, 
untreated control classes . Nested analysis of variance on CTBS' Computations 
scores adjusted for pretests indicated that in both experiments, TAI and 
AGAT exceeded MMP . In Experiment 2, TAI, AGAT, and MMP also exceeded 
control. No interactions with prior achievement were found, ■ Effects on 
fciking of Math Class and (in Experiment i) Self-Concept in Math favoreu 
TAI. 
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Introduction 



One of the most troublesome and enduring problems of mathematics 
instruction is accomodating heterogeneity in student preparedness and learning 
rate. If students do not have the prerequisite skills to learn a lesson, or 
if they have already mastered it before the lesson began or do so in the first 
minutes of the lesson, then instructional time for them is wasted. For 
example, it is of little use for students to sit through a lesson on dividing 
with two digit divisors if they: a) did not master one-digit division^ b) 
already know two-digit division, or c) learn the concept in a few minutes. 
Yet in most mathematics classes in which the teacher is teaching one lesson to 
the entire class, we can be certain that some students fall into one or 
another of these categories. In fact* it could be argued that if a teacher 
teaches a three-period lesson, the only students for whom time is used 
effectively are those who require neither more Hot less than three periods to 
master the skill or concept being taught (see Slavin, in press a). 

The most common means of dealing with the problem of heterogeneity are 
various forms of ability grouping of classes, such as tracking/curriculum 
placement, special education, and gifted classes. The purpose of such 
programs is to reduce classroom heterogeneity so that students' needs can be 
more efficiently met. However, decades of research oa tracking have failed to 
find achievement benefits of this practice for students as a whole (Esposito* 
1973; Good 5 Marshall, in press; Rosenbaumi 1980). Special education programs 
tend to be no more effective than regular classes for the achievement of 
students with mild academic handicaps (Madden & Slavin, 1983), and randomized 
studies of between-class ability grouping (i.e., tracking) arid of gifted 
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programs for high-ability students find few if any benefits for their 
achievement (Kulik S Kulik, 1982; Slavin, in press b). 

Another means of accomodating student heterogeneity is within-class ability 
grouping (e.g., reading or math groups), in which students are taught in 
ability-homogeneous subgroups within a larger, more heterogeneous classroom. 
Within-class ability grouping is virtually universal in elementary school 
reading instruction, but is less common (though still widely used) ^n 
mathematics. In contrast to between-class ability grouping, studies comparing 
within-class ability grouping to whole-class instruction most often find 
greater learning in the ability-grouped classes (e.g., Begle, 1975; Dewar, 
1963; Jones, 1948; Heathers, 1969.), although these effects are not entirely 
consistent. If true, the disparity between the achievement effects of 
within-class and between-class ability grouping is of great importance. One 
rensov for such a difference in effects is suggested in a recent study of 
within- and between-class ability grouping of fourth graders by Rowan and 
Miracle (1983), who found that, controlling for student ability, students in 
lower-track classes received a slower pace t>f instruction than students in 
highex-track class, but students in low reading groups received a faster , pace 
of instruction than those in high reading groups (i.e., they covered more 
reading levels per unit time). Faster pace was found in this study and others 
(see firophy, 1974) to be associated with greater learning. Also, low-track, 
classes may be difficult to teach because of concentrations of behavior 
problems, low morale, and a perception on the part of students that their 
classmates do not value learning. In contrast, low ability groups in 
heterogeneous classes may be superior on these counts to low-track classes 
because students in the low ability groups are still members of a class that 
has norms for appropriate behavior, is high in morale, and values learning 
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(see Slavin & Karweit, 1984). 

A third prevalent means of accomodating diverse learning needs is 
individualized instruction (Glaser, 1965), in which students work on materials 
at their own level and rate. Evaluations of individualized instruction in 
mathematics have not generally found benefits of these strategies for student 
achievement (Miller, 1976; Schoen, 1976). Slav in (in press a) has argued that 
these disappointing results are due to problems with management , motivation, 
and lack of direct instruction characteristic of individualized systems. An 
individualized instruction model directed at solving these problems by the use 
of cooperative learning teams and regular teacher-led instruction in small 
groups, Team Assisted Individualization (TAI) , has been found in three recent 
studies to be effective in increasing mathematics achievement more than 
traditional group-paced instructional methods (Slavin, Leavey , & Madden, in 
press; Slavin, Madden, & Leavey, in press). 

The present research . The purpose of the present research was to 
investigate the mathematics achievement effects of three commonly proposed 
methods of dealing with student heterogeneity: individualized instruction, 
within-class ability grouping, and whole-class instruction. The strategy 
adopted was to compare the effects of models typifying each of these levels of 
individual ization, each of which had been found in previous research to be 
more ef f ective . than traditional instruction. The whole-class model was the 
Missouri Mathematics Program (MMP), an instructional program emphasizing a 
high ratio of active teaching to seatwork, frequent feedback, smooth 
transitions be tween activities, and other features derived from the practices 
of outstandingly effective traditional teachers (Good, Grouws, & Ebmeier, 
1983). The MMP has been found to be more effective than control methods in 
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increasing student achievement (Good & GrbuwSj 1979). The ability-grouped 
methods Ability-Grouped Active Teaching (AG AT) , was designed for the present 
study (Slaviri & Karweit* 1983) to incorporate the major pr inciplec of the MMP 
in the context of a system employing two ability-homogeneous math groups. 
Final ly % the individualized instruction model was Team Assisted 
Individual izatibri (TAl) , discussed earl ier. 

The principal purpose of the present research was to compare the three 
methods described above in terms of their overall effects on student 
mathematics achievement, and their differential effects in different settings 
and for students of different levels of prior achievement. The research 
involved two related experiments conducted at the same time: one in urban 
classrooms in which heterogeneous class assignments were mandated as part of a 
desegregation plan, and the second in relatively homogeneous rural classrooms 
that used between-class ability grouping to reduce the heterogeneity of 
mathematics classes. It was hypothesized that the instructional programs most 
directed toward accomodating student heterogeneity , TAI arid AGAT, would be 
most effective in heterogeneous settings arid for students furthest from the 
class mean in past performance, while the group-paced instructional program 
(HHP) would be most effective in relatively homogeneous settings and for 
students closest to the cl^ss mean in prior performance . 



11 
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Experimen t 1: Methods 

S ubj e ct s . The subjects in Experiment 1 were 354 students in 16 grade 4-6 
classes in one of the Wilmington* Delaware school districts formed as a 
consequence of an extensive desegregation plan. Approximately 71% of the 
students were white, 26% were black, and 3% were Asian-American, 

Treatments . Classes and their "teachers were randomly assigned to three 
experimental treatment?. Teachers in each of the treatments received three 
hours of training, and were then assisted vith implementation in the early ts 
weeks of the program, which took place over a period of 18 weeks in Spring, 
1983. The treatments were as follows: 

1. Missouri Mathematics Program (MMP). The MMP (Good, Grouws, £ Ebmeier, 
1983) is a whole-class, group-paced mathematics program whose principal 
features were derived from studies contrasting the teaching strategies used by 
whole-class teachers whose classes consistently performed well to those used 

by teachers whose classes did poorly. It consists of a regular sequence of 

- , — _ - _ i$ -__ _ -_ - - _ - - _ 

teaching, controlled practice independent seatwbrk, and hbmevbrki with ah 

emphasis on a high ratio of active teaching to seatwbrk, teaching mathematics 

in the context of meaning, frequent questions and feedback, rapid pace of 

instruction, and management strategies intended to increase student time 

on-task. The training for the MMP was conducted by Dr. Thomas Good, its 

principal developer* 
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!• Ability Grouped Active Teaching (AGAT5. AGAT was developed for the 
present study as a means of applying the main principles of the MMP to an 
ability-grouped method (Slav in & Karweit, 1983). On the basis of an initial 
test, students in each ASAT class were divided into a high group (about 60% of 
the students in each class) and a low group (40% of the students)- Teachers 
were instructed- to differentiate pace and materials for the two groups, in 
particular to push the pace for the high group. In most other respects, AGAT 
was quite similar to the MMP. It emphasized a high ratio of active 
instruction to seatwork (in each group), teaching mathematics in the context 
of meaning, frequent questions and feedback, and management strategies 
(derived in part from the work of Anderson, Evert son, and Srophy, 1975, and 
Clements & Evertson, 1982) designed to minimize the management problems 
characteristic of ability-grouped instruction and maintain high time on-task. 
The training for AGAT was done together by the first author and Dr. Good. 

3. Team Assisted I ndividualization (TAI). The individualized model used 
was Team Assisted Individualization. TAI has been described in detail 
elsewhere (Slav in, Leavey, & Madden, in press). Briefly, students in TAI 
worked in heterogeneous four or five-member learning teams on individualized 
mathematics materials at their own levels and rates. Students within the 
teams helped one another with problems and took responsibility for almost all 
checking, routing, and other management tasks inherent in an individualized 
program. This student management freed the teacher to work with three 
regularly constituted teaching groups composed of students (drawn from many 
teams) performing at the same level in the materials. At the end of each 
week, students on teams that met certain pre-set criteria received attractive 
certificates. Team rewards of this type have been found in many previous 
studies (Slav in, 1983a, 1983b) to increase student motivation and achievement. 

-6- 

13 



TAI resembles earlier individualized models (see, for example* Talmage* 
1975) in its use of individualized materials that students complete at their 
own rates. It differs in its emphasis on direct instruction (in homogeneous 
teaching groups), student management, cooperative learning teams, and 
cooperative incentives. 

Me asur es 

1. Mathematics Achievement . The Mathematics Computations and Concepts and 
Applications subscales of the Comprehensive Test of Basic Skills (CTBS) were 
the achievement criterion measures. Fourth graders took Level 2, Form S, 
while fifth and sixth graders took Level H, Form U. District-administered 
California Achievement Test scores were used as covariates for their 
respective CTBS scores. That is* CAT Computations was used as a cbvariate for 
CTBS Computations , and CAT Concepts and Applications was a cbvariate for CTBS 
Concepts and Applications. Because of the different tests used at different 
grade levels , al 1 scores were transformed to T scores (Mean » 50 , S.D. = 10) , 
and then CTBS scores were adjusted for their corresponding CAT scores using 
separate linear regressions for each grade. These adjusted scores were used 
in all subsequent analyses. Note that this adjustment removes any effect of 
grade level, as the mean for all tests was constrained to be 50 at each grade 
level . 
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2. Attitudes , Two /eight-item attitude scales were given as pre- and 

posttests. They were liking of Math Class (e.g., "This math class is the best 

part of my school day") and Self-Concept in Math (e.g., "I'm proud of my math 

work in this class;" j "I worry a lot when I have to take a math test"). For 

each item, students marked either YES!, yes, no, or NO! Scores of negatively 

/ . . . . ._ . . ,.. 

phrased itons were reversed, so that high scale scores indicated more positive 

attitudes. Coefficient alpha reliability estimates on these scales were 

computed in an earlier study (Slav in, Leavey , & Madden, in press) and found to 

be .86 and .77. respectively. The range of possible scores on both scales was 

8 to 32, with a midpoint of 20. 

J3* Behavioral Observati on. Two forms of behavioral observation were used, 
primarily to determine adequacy of implementation of the various methods. 
First, TAI, AG AT, and MMP classes were observed to see that the main 
components of each treatment were in place. However, many of the components 
of the M*P and AGAT treatments were too subtle for simple implementation 
checks, so for this reason, more systematic observations were made in these 
classes. These observations took place for an average of three full 
mathematics periods per class distributed over the course of the experiment. 
Behaviors observed included amounts of time spent in active teaching* 
seatwork, and test-taking, md the percent of time students spent on-task. 
The observation system was derived from Karweit and Slavin (1981). 
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Ex p e riment 4: R e sults 

Implementat ion and Time Use . All teachers were found to be implementing 
the major components of their methods- AGAT and MMP~ students spent similar 
proportions of their instructional time on- task (92.0% and 90,1%, 
respectively), but as expected, AGAT students spent much more time in 
seatwork: 54.0% vsi 22.3% for MMP. AGAT teachers spent more time v eaching 
the class (82;3% vs; 73;2%) , but of course each student in AGAT received an 
average of half this amount of teacher instruction. 

Ach ievement . The adjusted CTBS scores were analyzed by means of 
random-effects nested analysis of variance , similar to analysis of variance 
using class means. The factors in the analysis were treatment and 
class/teacher within treatment . The mean square for treatment was tested 
against that for class/teacher within treatment, which was compared in turn to 
the within-cells error mean square. If the overall nested analysis of 
variance was statistically significant (p< .10 or better), individual-level 
planned comparisons between treatment means were computed using a modified 
Bonferroni procedure (keppel , 1982) to reduce the possibility of -type II error 

; \ 

due to many tests being made on the same data; 

Table 1 about here 



Table 1 summarizes the means and standard deviations of the CAT and CTBS 
scales and the adjusted CTBS scores in T scores and grade equivalents. The 
grade equivalent scores are presented as supplementary information; only the 
T-scbres were used in the analyses. Note that because the grade equivalents 



were combined across grade levels in the same manner as the T-scores, they are 
adjusted for differing numbers of students in each grade/treatment cell, and 
their standard deviations are computed as within-grade standard deviations. 

Initial tests for pretest differences using the same statistical procedures 
as in the main analyses revealed no pretest differences for Computations, but 
despite random assignment, there were marginally significant differences for 
Concepts and Applications (F(2,13) =2.91, p<.09), due to high pretest scores 

for TAI classes and low scores for MMP classes. Analyses involving Concepts 

j . : 

and Applications must be interpreted cautiously in light of these initial 
differences. 



Table 2 About Here 



Table 2 presents the results of the nested analyses of variance for the 
achievement measures. For Computations, the nested analysis was statistically 
significant (F(2, 13) - 6.27, p<.012), but there were no effects on the 
Concepts and Applications scale. As noted earlier, these random-effects 
nested analyses are virtually identical to class-level analyses of variance 
using class means. For example, a ciass-ievei analysis for Computations 
produced F(2, 13)=7i22, p<i008. Individual comparisons -Bm§ng treatment 
Computations means revealed that TAI and; AG AT means were nearly 4-dentical, but 
both were substantially higher than MMP. \ Table 2 presents the mean 
differences both in effect sizes (difference between adjusted means divided by 
the standard deviation) and in grade equivalent differences. As the table . 
indicates, both TAI and AGAT classes exceeded MMP classes by 75% of a standard 
deviation, or approximately 1.17 grade equivalents. 
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Tables 3 and 4 About Here 



Attitudes . Table 3 presents the means arid standard deviations of the two 
questionnaire scales, the data were analyzed as for the achievement analyses 
There were marginally significant pretest differences on Liking of ilatti Class 
(F(2, 13}« 3.08, p<. 085, due to low pretest score*: in the MMP classes. No 
differences were found on Self-Concept pretest scores. 

Table 4 summarizes the results of the attitude analyses. For Liking of 
Math Class, the overall nested analysis was statistically significant 
(F(2,13)=» 4.06, p<.043). Modified Bphferrohi comparisons revealed that the 
differences were due to low scores in the MMP classes; TAX and AGAT did not 
differ. Oh the Self-Concept in Math scale* the nested analysis was also 
significant (F(2* 13)= 4.15* p<.040)* but in this case* TAI students scored 
much higher than AGAT and MMP st udeht s » who did no t di f f er from one another. 
Oti both scales, it is interesting to note that hone of the treatment groups 
improved in attitudes over time; the treatment effects came about more as 
preventing a negative trend than causing a positive one. 

Experiment 2: Methods 

Subjects . The subjects in Experiment 2 were 480 students in 22 grade 3-5 
classrooms in and around Hagerstowh* a town in Western Maryland. Ninety-one 
percent of the students were white* IX were black* and 2% were Asian-American. 



T reatments . Classes and their teachers were randomly assigned to four 
experimental treatments. Three Of these were the MMP, AG AT, and TAI methods 
described above; the fourth was an untreated control group. Experiment 2 
began two weeks after Experiment 1 and continued for 16 weeks in Spring, 1983. 
in all other respects the treatments, training, observations, and other 
procedures were the same as in Experiment 1, except that Dr. Good was unable 
to participate in the training; 

Measures. The measures were the same as in Experiment 1, with students in 
grades 3 and 4 taking Level 2, Form S of the CTBS and fifth graders taking 
Level H, Form U. Also, because CAT's are given in the fall in grades 3 and 5 
but not grade 4 in Maryland, CAT scores for third and fifth graders were 
recent, but those used for fourth graders were their third grade scores. 
Because posttest scores were adjusted for the CAT's separately for each grade 
level, this should make little difference in the analyses. 

Experiment 2: Results 

o 

Implementation and Time. Use . All TAI, AG AT, and MP teachers were found to 
be implementing the major components of their methods. Time use in the AG AT, 
MMP, and Control classes corresponded closely with expectations. Time on-task 
was greatest in HHP (94.3% of instructional time), less in Control (87.2Z), 
and least in AGAT (84.4%). Seatwork time was least in HHP (22.6% of 
instructional time), intermediate in Control (34.6%), and greatest in AGAT 
(52.1%). AGAT teachers spent the largest amount of time teaching (89.6%), 
followed by HHP (77.7%) and Control (59.6%), but as noted for Experiment 1, 
AGAT students each received only about half this amount of teacher 
instruction. 
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Achievement » Analyses for Experiment 2 were the same as for Experiment 1. 
Table 5 summarizes the means and standard deviations of /the achievement 
measures. Pretest differences were hot statistically significant for 

o 

Computations, but- despite random assignment, there were statistically 
significant differences on Concepts and Applications (F(3, 18)= 3.89, p<.026), 
due to aigh pretest scores in AGAT classes arid low scores in Control clases. 



Tables 5 and 6 about here 



As is shown in Table 6, the overall nested analysis of variance was 
marginally significant for Computations (F(3,18)=2.71 , p <.076) . Modified 
Bonf erroni comparisons indicated that as in Experiment 1 , AGAT and TAI did not 
differ in effects on Computations, but both were superior to MMP. All three 
experimental conditions exceeded Control. Also, as in Experiment 1 , the 
nested analysis of variance for Concepts and Applications did not approach 
statistical significance (F(3 , 18)=1 .94 , h.s.). 



Tables 7 arid 8 about here 



Attitu des » Tables 7 arid 8 ^present descriptive statistics and analyses, 
respectively, for the attitude variables in Experiment 2. There were no 
statistically significant pretest differences on either attitude scale. For 
Liking of Math Class, the overall nested analysis of variance was 
statistically significant (F(3, 185=5. 41 , p<. 008) , \ith modified Bonf erroni 
comparisons indicating that TAI students significantly exceeded all others* 
but AGAT and MMP did hot differ. MMP students exceeded Control students, but 
\ 
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AGAT did hot differ from Control . On Self ^Concept in Math, the nested 
analysis of variance was hot significant (F(3 ,1 8)«0;52, tils*). 

Jttte r aet 4oha 

It was expected that the different programs evaluated in Experiments i and 
2 would hav^ different achievement effects for students of different levels of 
past performance (either absolute or relative to their class averages), race, 
or sex. Individual-level analyses of covariance were conducted to test for 
such interactions with treatment. Students were trichotomized on: a) absolute 
past performance (the mean of their standardized CAT pretests), and b) 
performance relative to their own class averages, the resulting analyses of 
variance thus tested both linear and curvilinear effects of past performance 
(that is, the pretest by treatment interaction would have been significant if 
high or low achievers benefitted disproportionately from one or another 
treatment or if high and low achievers benefitted more than average 
achievers). Becaus^ of the great power of the individual-level analyses, an 
alpha criterion of .01 was chosen for tests for interactions. Contrary to 
expectations^ ho interactions between treatment and absolute or relative 
achievement level, sex, or race were found in either experiment (race by 
treatment interactions were tested in Experiment i only). 

Discussion 

There is a remarkable degree of commonality of findings regarding student 
achievement across the two experiments reported here. In both^ Team Assisted 
Individualization (TAI) and Ability Grouped Active Teaching (AGAT) increased 
computational skills markedly more than the Missouri Mathematics Program (MMP) 
and, in Experiment 2^ ah untreated control condition. In neither experiment 
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were any differences between TAI arid AGAT found; arid iri neither were there 
statistically significant differences in Concepts and Applications; The 
similarity iri achievement effects was particularly striking- in light of the 
differences between the urban> integrated, untracked schools studied in 
Experiment 1 and the rural, mostly white, tracked schools involved iri 
Experiment. 2. Along the same lines, it was surprising to find that the 
achievement effects were main effects; no statistically significant 
interactions were found between treatment and either absolute levels of prior 
achievement or prior achievement relative to class means. These findings 
contradict the expectation that the effects of TAI and AGAT, programs designed 
to accomodate diverse achievement levels, would be most positive for students 
performing farthest from, their class means and in settings with the greatest 
degree of student heterogeneity. 

One difficulty with the data from the present study is pretest differences. 
Despite random assignment, pretest differences were statistically significant 

for Concepts arid Applications in both studies, and though not statistically 

)'■ - 

significant for Computations iri either study, they were large enough to 
warrant caution iri interpreting results. When pretests are unequal ; 
statistical controls for pretest tend to urideradjust (Lord* 1960). However 
in the present studies the magnitude of treatment effects on Computations 
might be overstated because of pretest differences, but the effects themselves 
cannot be entirety ascribed to pre-test differences. For example, the 
difference between TAI and MMP increased over the course of Experiment i from 
.36 standard deviation units to .81 units, and in Experiment 2 from .15 units 
to .41. The AGAT-MMP difference increased from .14 standard deviation units 
to .70 in Experiment 1 , and from .33 to .62 in Experiment 2. These effects 
appear too large tb.be attributable to pretest differences alone. 

-15- 
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The findings of the present studies with regard to computations skills have 
important implications for several research traditions; The success of TAI in 
increasing student achievement replicated findings of earlier studies 
evaluating this method (Slav in, Leavey, & Madden, in press; Slav in, Madden* & 
Leavey, in press), lending further support to Slavin's (in press ( a) prediction 
that if inherent problems of management, motivation, and lack of direct 
instruction could be solved, individualized instruction could be made 
instruct ionally effective. The positive effects of TAI also support the 
utility of student learning teams for student motivation and instructional 
management (Slaviti, 1983b). 

The success of the AGAT program was more surprising. While previous 
research on withi a-class ability grouping has found more positive than 
negative effects of this practice on student achievement, these effects have 
been neither strong nor consistent (Begle, 1975). The substantial positive 
effects of AG AT seen in the present studies may be due to the specific method 
of implementing within-class ability grouping, which specified class 
management strategies derived from the work of Anderson, Evertson, and Srophy 
(1979) and Clements and Evertson (1982). Within-class ability grouping may be 
seen as producing gains in instructional effectiveness by providing 
appropriate levels of instruction that are offset to some degree by losses in 
instructional effectiveness due to the difficulty of managing multiple ability 
groups. If these management problems can be solved, within-class ability 
grouping may be a particularly effective procedure (see Slav in & Karweit, 
1984). Finally, the success of the MMP relative to untreated control classes 
in Experiment 2 replicates earlier work by Good et al . (1983), reemphasizini 
the importance of active teaching and effective management strategies in the 
context of group-paced instruction. 

-16- 



Jhe failure to find any statistically significant interactions was 
unexpected and intriguing. If AGAT and TAI-are effective even in part because 
they increase appropriate levels of instruction for students, they should have 
especially strong positive effects on the achievement of students farthest 
from the class mean in prior performance. The fact that the positive effects 
of these programs were equal for all students might suggest that they are 
effective hot because they accomodate heterogeneity in student preparation and 
learning rate* but because they provide more effective instruction in general. 
For example, it is important to note that both AGAT and TAI are highly 
structured instructional models. Teachers arid students know what they are to 
do at any given moment. In contrast , the MMP involves subtle (though 
important ) " changes in teaching practices , such that MMP and Control classes 
could riot be easily discriminated in observations. It may be that the 
structured nature of the AGAT and TAI treatments contributed to their 
effectiveness. In fact, it might be argued that these methods, because of the 
explicit directions for teachers and well-specified routines for students, 
might be more faithful operational izations of the principles on which the MMP 
is based than the MMP itself, and the more positive achievement effects 
observed for these methods might val idate rather than repudiate these 
principles. 

The resul ts of these experiments should give pause to any who might 
overemphasize the importance of time on-task or of teacher-directed 
instruction as opposed to seatwork. The issue is more complex than might have 
been assumed earlier. Comparing MMP to Control , greater teaching . time and 
slightly higher time on-task for the MMP may be at least partially responsible 
for the superiority of the MMP on Computations in Experiment 2. That is* a 
high percent of time on active instruction and high time on-task may make a 



difference .in ^fre cont e xt paced instruction . Outside of that 

context* though* the effects of time oh-task are ihuch less clear; In both 
experiments* AGAT students spent more than twice as much of their time in 
seatwork than did MMP students, and in Experiment 2 were much less 6n-task 
(probably because of the high amount of seatwork time, which has been 
associated with low time on-task; see Brophy, 1979). TAI students (who were 
not observed) probably spent even more of their time in seatwork. Yet TAI and 
AGAT students learned more than did MMP or Control students. It might well be 
the case that Song AGAT classrooms or among TAI classrooms* the amount of 
active teaching and time on-task would make difference in the predicted 
direction, but comparing across methods is another matter. In traditional 
group-paced teaching, seatwork may be less than optimally effective hot 
because it reduces time bri-task but because it is rarely well adapted to the 
needs of various students* many of whom are either practicing errors or 
working problems they already know how to do (see Anderson, 1981). In AGAT 
and especially TAI* seatwork is likely to be more productive, as it is closely 
keyed to students' individual heeds • 

The failure in both studies to find any treatment effects on Concepts and 

Applications contrasts sharply with the findings for Computations. This 

. ' 

discrepancy, which is not uncommon in research on mathematics instruction, is 

probably due to relatively low correspondence between what is taught in school 

and what is tested by the Concepts and Applications scales. While virtually 

all skills tested on the Computations scale are taught in school, Concepts and 

Applications tests include many items that appear to tap general aptitude 

rather than school learning, as well as many word problems that depend as much 

on reading skill as bri mathematics knowledge. 




At least as far as computational skills are concerned, the results of the 
present studies provide striking evidence that methods which include means of 
adapting instruction to diverse needs can he considerably more effective than 
methods that do hot. However* the success of TAX and AGAT should emphatically 
net be interpreted as justification of individualized instruction or 
withih-class ability grouping in gen eral . Previous research has clearly 
indicated that individualized instruction as usually structured is no more 
effective than traditional methods in mathematics (Miller, 1976; Schcen, 
1976), and within-class ability grouping is only inconsistently more effective 
than traditional methods (Begle, 1975), What the results of the present 
studies do mean is that if problems of management and motivation inherent in 
attempts to accomodate student heterogeneity can be solved,, then such methods 
may be able to achieve the outcomes for which they were designed — enhanced 
achievement for all students. 

In both experiments, TAi was associated with more positive student 

s - - 

attitudes toward math class than was MMP or (in Experiment 2) untreated 
control methods, and in Experiment 2, TAI was also significantly superior to 
AGAT on this variable. - TAI students reported more positive self-concepts in 
mathematics than AGAT or MMP students in Experiment 1 , but there were no 
differences on this variable in Experiment 2. The positive effects of TAI on 
student attitudes repl icate findings for cooperative learning methods in 
general (Slaving 1983a) and for TAI in particular (Slav in, Leavey , & Madden, 
in press). In addition to positive attitudes expressed by students, teachers 
also responded favorably to the TAI program. On questionnaires given at the 
end of Experitaents i and 2, more than half of all TAI teachers indicated that 
M TAI was by far the best method I've used to teach math." Not one of the AGAT 

c - - - 

teachers and only one-third of the MMP teachers agreed with similar statements 
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about their methods. At the end of the experiments, teachers were allowed to 
choose any method other than the one they had used before in which to receive 
training and materials. Every eligible teacher chose TAI* and every TAI 
teacher has continued to use the program during the next (1983-84) school 
year. None of the AG AT teachers continued to use the program. One possible 
reason for the relative unpopularity, of the AGAT treatment is the amount of 
teacher work required; 88% of the AGAT teachers felt that AGAT required more 
work from them than their usual methods, while only 40% of TAI teachers and 
25Z of MMP teachers responded this way. 

The outcomes of the present studies suggest many directions for further 
research. First, the effects themselves (particularly the effects of AGAT) 
should be replicated in field experiments involving larger numbers of teachers 
and classes at each grade level — combining across grade levels, necessitated 
by the small number of classes involved, may have obscured important 
developmental trends. Also, the unfortunate pretest differences on some 
measures (despite random assignment) could account for a portion of the 
effects observed. Adjustment of post tests for pretest scores only partially 
solves this problem; further replication is clearly heeded. Second, more 
detailed and extensive observations of treatment implementation arid collection 
of data on - such variables as student motivation and perceptions would allow 
for better understanding of how and why the various methods produce their 
effects. Finally, component analyses of the complex TAI and AGAT programs are 
needed to establish which elements of these programs .affect student 
achievement. 

One major drawback of recent research on teaching (e.g., Brophy, 1979) is 

«-W~*. 4#- 1 a t»r>Al « *»/*rte<2 ct- a rif r> ri ir-ir <a1 a ^ i rtti a il ( lit-orp H 15— TVT odnct 5 Studies relating 



teaching practices to student achievement but comes in traditionally taught 
classrooms. Although this line of research has added much to our 
understanding of effective teaching practices, its correlational nature makes 



restriction to traditionally taught classrooms limits its prescriptions to the 
range of current widespread practice. Slavin (in press a) has called for a 
movement in research on teaching toward experimental studies evaluating 
alterable components of instruction, the present research represents one step 
in this direction, focusing on means of accomodating heterogeneity in 
mathematics instruction. Much work of this kind remains to be done before we 
will have a true scientific basis for instruct ional practice. 



it subject to errors in understanding direction of causality, and its 




ERIC 



References 



Anderson, L.M. (1981) . Studen t response to seatwork : Implications for the 

study gf students'* cognitive p rocessing . Paper presented at the Annual 
Convention of the American Educational Research Association Los Angeles. 

Anderson, L.M. , Evertsom C. , SBrophy* J- (1979). Ah experimental study of 
effective teaching in first-grade reading groups. Elementary School 
Journal, 7£, 193-223. 

BegleV E. (1975). Aki-l-i-fev- grouping Mathematics instruction: A review of 
^4te Emp irica l 4^fe e rature . Stanford University, Stanford Mathematics 
Education Study Group. 



Brophy, J.E. (1979). Teacher behavior and its effects, journal of 
Educational Psychology . 71, 733-750. 

Clements, B. , & Evertson, C. (1982). Orchestra ting small group instruction 
elementary school classrooms . (Technical Report No. 6053). University 
of Texas, Research S Development Center for Teacher Education. 



Dewar, J. (1963). Grouping for arithmetic instruction in sixth grade. 
Elementary School Jo urna l 63 , 266-269. 



Esposito, B. (1973), Homogeneous and heterogeneous ability grouping: 

Principal findings and implications for evaluating' and designio,, -rco r 
effective educational environments. Review of -Educational R _ey- -z o ~ *: h , £-3 , 



C 1 a s e r ; R. (1965). Teaching machines and pr o&r agin t oj-l 4 earning ^ : 
cl-ireet ions . Washington, D.C. : National Education Association* 



Good, T. , & Grbuws, D. (1979). The Missouri Mathematics Ef f ec L i. vencr-'. 
Project: An experimental study iv four Lri j;rade classrooms \ ; : :.-;\->v 
Ed tic at iorral Psych ology , 7 1 , 35 5-3 o ~ - 



Glass;- G. , & Stanley, 3. (1970). St/K ..is t ical methods in educatio n 
psychology . Englewood etiffs, MI: X'r^w t i: ce -tial i ; 

Good, T; , Grouws, D. , & Ebraeier, H. "(1933). Active mathematic s teach in:. , . 
New York: Longman. 



or homogeneous groups? Th P.E. Peterson, L,C. Wilkinson, & M.T. Hal 1 in an 
(Eds.), Stud e nt ^div ersity and the. •organisation . proc ess , and use of 
ins tru c t ion a l^ groups in the clasjsr^om. New York: Academic Press.. 



163-179. 




Good, T. , & Marshall , S. (in press). Do students le.irn more in het^r^.v" >:ms 



Heathers* G. (1969). Grouping. In R. Ebel (Ed.) Encyclopedia of Educational 
R e s e arch (4th ed.). New York: Macmillan. 

Hopkins, R. (1982). The unit of analysis: Group means versus individual 
observations. American Educational Research Journal , 19 , 5-18. 

Jones, B. M. (1948). An experiment in adaptation to individual differences. 
Journal of Educational Psychology , 39 , 257-273. 

Karweit, H. , & Slavin, R.E. (1981) . 
studies of time and learning. 
157-171. 



Keppelj G. (1982). Des ign and analysis . Englewood Cliffs, NJ: 
Prentice-Hall. 

Kulik, C. L. , & Kulik, J. (1982). Effects of ability grouping on secondary 
school students : A meta-analysis of evaluation findings. A merican 
E ducational Research Journal, 19 , 415-428. 

Lord, F. (1960). Large-sample covariance analysis when the control variable 
is fallible. Journal of the American ^t^at^s^eal Assoc iat ^Lofl, 35. 
307-321. 



Measurement and modeling choices in 

can Educational Research Journal , 18, 



Madden, N.A. , & Slavin, R.E. (1983). Mainstreaming students with mild 

academic handicaps: Academic and social outcomes. Review of Educational 
Resea rch. 53, 519-569. 



Miller, R. L. (1976). Individualized instruct ion in mathematics: A review 



Rosenbaum, J. (1980). Social implications of educational grouping. Review 
of Re searc h in J&ucat_ion, 8, 361-401. 

Rowan, B. , i Miracle, A.. (1983). Systems of ability grouping and the 
stratification of achievement in elementary schools. Sociology of 
Education. 56 , 133-144. 

Schben, H.L. (1976). Self-paced mathematics instruction: How effective has 
it been? Arithmetic Teacher , 23 , 90-96. 

Sharan, S. (1980). Cooperative learning in small groups: Recent methods and 
effects. on achievement, attitudes* and ethnic relations. Review of 
Educational Research , 50. 241-271. 

Slavin, R.E. (1980). Coop e rative l e arn ing . New York: Longman. 




of research. Mat4rematle& teacher 69 , 345-351. 




ERIC 



Slav in, R. E. ( 1983a) . When does cooperative learning increase student 
achievement? Psychological jfeli^t^Si 94 , 429-445. 

Slaving R.E. (in press a). Component building: A strategy for "research-based 
instructional improvement. Elementary School Journal * 

Slav in, R.E. (in press b) . Meta-analysis iii education: How has it been 
used? Educat ional Researcher . 

Slavin, R.E., & Karweit, N. (1983). Ability grouped active teaching (AGAT): 
Tea cher^s manual . Baltimore: Johns Hopkins University , Center for 
Social Organization of Schools, 

Slavin, R.E.* & Karweit, N. (1984). Within-class ability grouping and 
student achievement : Two. fj.e_ld experiments . Paper presented at the 
Annual Convent ion of the American Educational Research Association, New 
Orleans. 

Slavin, R.E., Leavey, M. , £ Madden, N.A. (in press). Combining cooperative 
learning and individualized instruction: Effects on student mathematics 
achievement, attitudes, and behaviors. Elementary School Journal . 



Slavin, R.E., Madden, N.A. , & Leavey, M. (in press). Effects of Team 

Assisted Individualization on the mathematics achievement of academically 
handicapped and non-handicapped students. Journal Ed ucation al 
Psychology . 



Talmage, H. (Ed,). (1975). System s of in dividualized education . Berkeley, 
CA: McCutchan. 



9 

ERLC 



Table 1 



Means and Standard Deviations in T-Scores ■ • 

and' Grade Equivalents, Mathematics Achievement Measures, Experiment 1 



TAI 



.AG AT 



TOTAL 





Computa t ions 




Concept: 


s and Applica 


l i ions 




CAT (Pre; 


CTBS (Post) , 


Adjusted 


CAT (Pro) 


CTBS (Post) 


Adjusted 


T 


52.03 


53-50 


52:66 


54.23 


53.00 


49.84 


S 


(10.73) 


(9.83) 


(8.86) 


(10.78) 


(10:84) 


(6.87)" 


G.E. 


5.51 


7.16 


7.01 " 


6.07 


7.12 


'6.57 


S 


(1-12) 


(1-74) 


(1.56) 


(1.53) 


(1.87) 


(1.19) 


N 


122 






123 




T 


49-77 


52.48 


52.67 


49.11 


49.77 


50:41: 


S 


(10.21) 


(9.60) 


(8.55) - 


(8.65) 


(8.77) 


(7.11) 


G.E. 


5.28 


6.98 


7.01 


5.34 


6.56 


6.67 


S 


(1.07) 


(1.69) 


(1.51) 


(1-23) 


(1.51) 


(1.23) 


K 


89 






89 . 




T 


48.40 


45.44 


46.04 


46.90 


47:55 


49.88 


S 


(8.85) 


(8.51) 


(7.60) 


(8.71) 


(9.24) 


(6.51) 


G.E. 


5.13 


5.74 


5.84 


5.03 


6.18 


6.58 


S 


(0.92) 


(1-50) 


(1.34) 


(1.24) 


(1.59) 


(1.13) 


. N 


142 






142 




T 


50.00 


50.00 


50.00 


50.00 


50.00 


50.00 


S 


(10.00) 


(10.00) 


(8.89) 


(10.00) 


(10.00) 


(6.77) 


G.E. 


5.30 


6.54 


6.54 


5.47 


6.60 


6.60 


S 


(1-04) 


(1.76) 


(1-57) 


(1.42) 


(1,72) 


(1.17) 


N 


353 






354 . 





Note: table entries are t scores (Mean=50 , S,.D. = 10) computed separately for 

each grade level. Adjusted scores are CTBS (Post) scores adjusted foi 
CAT (Pre) scores separately for each grade level. 
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Table 2 

Results of Nested Analyses of Variance, Adjusted 
Mathematics Achievement, Experiment 1 



:e of 
ition 

tment 



Computations 
•d.f . M.S. F 



3 /Teacher 13 
in Treatment 



r (within 



337 



2.97 4.95 



0.60 



18.61 6.27 .012 



.001 



ConcepJ 



d.f. M.S. 



0.10 



)ii cations 



_12_ 



0.13 n.s. 



13 0.77 1.73 .054 



338 0.45 



srences between Adjusted Means in 

zt Sizes and (Grade Equivalents) , Computations 



TAI 



AGAT 



MMP 



,00 j + .75*** 
(.00) (+1.17) 

— + .75*** 

(+1.17) 



,001 Using Modified Bbnferroni Procedure 
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Table 3 



Means and Standard Deviations , 
Attitude Scales, Experiment 1 







Liking 


of Math 


Class 






Micept in 


Math 








Bast 


Adjusted 


Pre 


Post 


Adjusted 


TAI 


X 


25.15 


25.16 


24. 


67 


24. 


10 


25.01 


24.70 


s 


5.35 


4.78 


4. 


06 


4 . 


65 


4.11 


3.35 




N , 




120 










117 




AGAT 


X 


24.99 


24.48 


24. 


06 


24. 


15 


23.31 


22.98 


s 


5.04 


4.90 


4. 


41 


4. 


12 


4.44 


3.57 




N 




86 . 










80 




MMP 


X 


22,71 


21.65 


22. 


35 


22. 


86 


22.68-- 


^23.13 


s 


5.96 


6.01 


5. 


42 


4. 


66 


"5 .10 


4.09 




N 




135 










139 




TOTAL 


X 


24.14 


23.60 


23. 


60 


23. 


60 


23.64 


23.64 


s 


5.63 


5.55 


4. 


83 


4. 


56 


4.72 


3.80 




N 




341 










336 





Note: Table entries are raw scores from 8-item attitude scales. Range 

of possible scores: 8-32. Adjusted scores are posttests adjusted 
for pretests . 



Table 4 

Results of Nested Analyses of Variance, 
Adjusted Attitude Scales, Experiment 1 



Source of 
Variation 

Treatment 

Class/Teacher 
Within Treatment 

Error (within 
cells) 



Liking of Math Clasps 
d.f. M.S. 1 _EJ 



13 



325 



Differences between. Adjusted "Means 
in I!f feet Sizes, Liking of Math Class 



TAI 



TAI 

AGAT 

MMP 



AGAT 



+ .13 



MMP 

+.48*** 
+.35*** 



p *1 .01 Using Modified Bonferroni Procedure 
p .001 Using Modified Bonferroni Procedure 



183.74 4.06 .043 



45.28 2.11 .013 



21.43 



Self-Concept in Math 
d.f. M.S. F 



101.86 4.15 



13 



320 



.040 



24.52 1.82 ; .039 



13.45 



Differences between Adjusted Means 
in Effect Sizes , Self-Concept in Mat! 



TAI 



AGAT 



MMP 



TAI 

AGAT 

MMP 



+.45*** +.41** 
-.04 
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Table 5 



Means and Standard Deviations in T-Scores 
and Grade Equivalents, Mathematics Achievement Measures Experiment 2 



Cozapa tat ions 
GAT (Pre) CTBS (Post) Adjusted 



Concepts and Applications 
CAT (Pre) CTBS (Post) Adjusted 



TAi 



AGAT 



*iMP 



CONTROL 



TOTAL 



T 
S 

G.E. 
S 
N 

T 

S 

G.E. 
S 
N 

T 
S 

G.E. 

S 
N 

T 
S 

G.E. 

S 
N 

T 
S 

G.E. 
S 
S 



51.35 
(9.05) 
4.64 
(0.79) 



53.16 
(8.81) 
4.79 
(0.77) 



49.84 
(10.76) 
4.51 
(0.94) 



45.91 
(9.41) 
4.16 
(0.32) 



50.00 

(10-00) 
4.52 
(0.87) 



52.92 
(9.64) 

6.31 
(1-51) 

112 

54.99 
(10.12) 

6.63 
(1-58) 

98 

48.80 
(8.24) 

5.66 
(1.29) 

162 

44.15 
(9.29) 

4.94 
(1.45) 

106 

50.00 
(10.00) 
5.85 
(1-56) 
478 



51.83 


52.21 


51.07 


59.27 


(7.95) 


(8.96) 


(9.15) 


(7. 13) 


6. 14 


5.36 


6.03 


5.71 


(1.24) 


(1.16) 


(1.62) 


(1.27) 




114 




53.49 


55.40 


57.05 


53.31 


(8.58) 


(10.46) 


(9.90) 


(7.26) 


6;50 


5.77 


7.09 


6.53 


(1.34) 


(1.35) 


(1.76) 


(1.29) 




98 




48.92 


48.19 


47.92 


49.21 


(7.54) 


(8.91) 


(9.10) 


(6.55) 


5.68 


4.84 


5.47 


5.70 ' 


(1.18) 


(1.15) 


(1:61) 


(1.16) 




162 




46.49 


45.39 


•45.51 


48.93 


(7.97) 


(9.27) 


(8.48) 


(6.01) 


5.30 


4.48 


5.05 


5.65 


(1.25) 


( 1 .-20) 


(1.50) 


(1.07) 




106 




50.00 


50.00 


50.00 


50.00 


(8:32) 


(10.00) 


(10.00) 


(6.92) 


5.85 


5.07 


5.85 


5.85 


(1.30) 


(1.29) 


(1.77) 


(1.23) 




580 





Note: 



Table entries are T scores (Mean-50, S .D.=10) computed separately for 
each grade level. Adjusted scores are CTBS (Post) scores adjusted f< 
CAT (Pre) scores separately for each grade level. 



Table 6 

Results of Nested Analyses of Variance, Adjusted 
Mathematics Achievement, Experiment 2 







Compu taticm& 




Concepts and i 


applications 


Source of 
Variation 






.076 


d.F. M.S. 




Treatment 


3 


10.22 2.71 


3 4.52 


1,94 n.s. 


Class/Teacher 
Within Treatment 


18 


3.78 7.43 


.001 


18 2.33 


6 .16 .001 


Error (within 
cells) 


456 


0.51 




458 0.38 




Differences between Adjusted Means in 

Effect Sizes and (Grade Equivalents), Computations 






TA1 


AGAT MM? 


CONTROL 






TA1 


(- 


•20 +.35** 
.26) (+.46) 


+ .64*** 
(+ .84) 






AGAT 




+.55*** 
(+.72) 


+ .84*** 
(+1.10) 






MMP 






+ .29* 
(+ .38) 


% 




CONTROL 













><.05 using Modified Bonferroni Procedure 
p< i01 us ing Modified Bonferroni Procedure 
P<C.001 using Modified Bonferroni Procedure 
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Table -7 



Means and Standard Deviations ^ 
Attitude Scales, Experiment 2 







Liking 


of Math 


Class 


Self-C 










Pre 


Post 


Adjusted 


Pre 


Post 


Adjusted 


TAI 


— 


4 /. 






25 . 71 


25.50 


25.25 


o 


5 91 


4-93 


5.51 


5.60 


5.67 


5.05 




N 




95 






96 




AGAT 


X 


26-07 


24-76 


25.30 


25.07 


25.83 


25 . 36 


s 


4.77 


5.34 


5.55 


5.58 


5.52 


3.55 




N 




90 






89 




MMP 


X 


25-S6 


25.33 


25.24 


23.85 


25.56 


25.81 


s 


4.85 


5.4.4 


4.49 


5.65 


5.80 


3.81 




N 




153 






157 




Control 


. X 


25-07 


22.81 


22.97 


23.78 


25.88 


25.17 


_s_ 


5,99 


6-63 


4.54 


5.57 


5.29 


3.50 




N 




86 






93 




TOTAL 


X 


25.32 


24.95 


24.95 


25.27 


25.67 


25.67 


s 


5-33 


5-69 


4.67 


5.62 


5.60 


3.73 




N 




424 






535 





Note: Table entries are raw scores from 8-item attitude scales. Range 

of possible scores: 8-32. Adjusted scores are posttests adjusted 
for pretests. 



Table 8 

Results of Nested Analyses of Variance, 
Adjusted Attitude Scales, Experiment 2 



Source of 

Treatment 

^lass/Teacher 
Within Treatment 

Srror (within 
-ells) 



Liking of Math Glase 
d.f . M . S. F . -^-< 



18 



402 



249.70 5.41 .008 



46.17 2-42 .001 



Self-Concept in MatH 

M . S . F p*L 



19.04 



18 



413 



17.38 0.52 



33.38 2.56 



13.03 



n.s . 



.003 



)ifferences between Adjusted Means 
.n Effect Si ^es, Liking, of Math Class 



TAI 



'AI 

:GAT 

MP 

0NTR0L 



AGAT 



+.56*** 



MMP 

+•36** 

-.20 



CONTROL 
+.84*** 
+.28 
+. 49*** 



** 



P «< .01 Using Modified Bonferroni Procedure 

k 

p «C ,001 Using Modified Bonferroni Procedure 
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about their methods. At the end of the experiments, teachers were allowed to 
choose any method other than the one they had used before in which to receive 
training and materials. Every eligible teacher chose TAI* and every TAI 
teacher has continued to use the program during the next (1983-84) school 
year. None of the AGAT teachers continued to use the program. One possible 
reason for the relative unpopularity, of the AGAT treatment is the amount of 
teacher work required; 88% of the AGAT teachers felt that AGAT required more 
work from them than their usual methods, while only 40% of TAI teachers and 
25Z of MMP teachers responded this way. 

The outcomes of the present studies suggest many directions for further 
research. First, the effects themselves (particularly the effects of AGAT) 
should be replicated in field experiments involving larger numbers of teachers 
arid classes at each grade level — combining across grade levels, necessitated 
by the small number of classes involved, may have obscured important 
developmental trends. Also, the unfortunate pretest differences on some 
measures (despite random assignment) could account for a portion of the 
effects observed. Adjustment of post tests for pretest scores drily partially 
solves this problem; further replication is clearly needed. Second, more 
detailed and extensive observations of treatment implementation arid collection 
of data on such variables as student motivation and perceptions would allow 
for better understanding of how and why the various methods produce their 
effects. Finally, component analyses of the complex TAI and AGAT programs are 
needed to establish which el ements of these programs .affect student 
achievement • 

One major drawback of recent research on teach ing (e.g., Brophy, 1979) is 
that it largely consists of correlational (process-product) studies relating 
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teaching practices to student achievement outcomes in traditionally taught 
classrooms. Although this line of research has added much to our 
understanding of effective teaching practices, its correlational nature makes 



restriction to traditionally taught classrooms limits its prescriptions to the 
range of current widespread practice. Slavin (in press a) has called for a 
movement in research on teaching toward experimental studies evaluating 
alterable components of instruction. The present research represents one step 
in this direction, focusing on means of accomodating heterogeneity in 
mathematics instruction. Much work of this kind remains to be done before we 
will have a true scientific basis for instructional practice. 



it subject to errors in understanding direction of causality, and its 
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Means and Standard Deviations in T-Scbres • • 

and' Grade Equivalents, Mathematics Achievement Measures, Experiment 1 



TAI 



. AG AT 



MM? 



TOTAL 







UOiupU. L.H fc lOUb 




Cnnren t*S 


and Applies 


l i ions 




CAT (Pre; 


Li.DJ V * OSt/ 


rVvl J Uo L. t_ U. 


pax ( P i: ej 


CTBS ( Post) 


Adjusted 


T 


52.03 


53.50 


52.66 


54.23 


53.00 


49.84 


S 


(10.73; 




^ O . OO ) 


no 7 


(10:84) 


(6.87)" 


G-E- 


C CI 

_>•_)! 


7 - 1 A 


7 -Hi r 


6 .07 


7.12 


'6.57 


S 


(1-12; 


/ i - j A S 

C 1 - 74) 


^ I .do; 




( 1.875 


(1.19) 


N 


1ZZ 






123 




T 


49-77 


52.48 


52.67 


49.11 


49.77 


50.41: 


S 


(10.21) 


(9.60) 


(8.55) - 


(8.65) 


(8.77) 


(7.11) 


G.E. 


5.28 


6.98 


7.01 


5.34 


6.56 


6.67 


S 


(1.07) 


(1.69) 


(1.51) 


(1-23) 


(1.51) 


(1.23) 


N 


89 






89 . 




T 


48.40 


45.44 


46.05 


46.90 


47.55 


49.88 


S 


(8.85) 


(8.51) 


(7.60) 


(8.71) 


(9.24) 


(6.51) 


G.E. 


5.13 


5.74 


5.84 


5.03 


6.18 


6.58 


S 


(0.92) 


(1-50) 


(1.34) 


(1.24) 


(1.59) 


(1.13) 


N 


142 






142 




T 


50.00 


50.00 


50.00 


50.00 


50.00 


50.00 


S 


(10.00) 


(10.00) 


(8.89) 


(10.00) 


(10.00) 


(6.77) 


G.E. 


5.30 


6.54 


6.54 


5.47 


6.60 


6.60 


S 


(1.04) 


(1.76) 


(.1-57) 


(1.42) 


(1.72) 


(1.17) 


N 


353 






354 . 





Note: table entries are t scores (Mean=50 9 S,.D . = 10) computed separately fo 
each grade level. Adjusted scores are CTBS (Post) scores adjusted 
eAT (Pre) scores separately for each grade level. 
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Table 2 



•urce of 
tria tion 

eatment 

.ass/Teacher 
.thin Treatment 



2 
13 



riror (within 337 
ills ) 



Results of Nested Analyses of Variance, Adjusted 
Mathematics Achievement, Experiment 1 



Computations 
M.S . -F 

18.61 6.27 
2.97 4.95 

0.60 



.012 
.001 



Concept s ^rrd Applications 
d.f . M.S. F n < 



2 
13 

338 



0.10 
0.77 

0.45 



0.13 
1.73 



n . s . 

.054 



:fferences between Adjusted Means in 

'feet Sizes and (Grade Equivalents) , Computations 



TAI 



ip 



AGAT 

o00 
(.00) 



MMP 

+ .75*** 
(+1.17) 

+ .75*** 
(+1.17) 



c: .001 Using Modified Bonferroni Procedure 
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Table 3 

Means and Standard Deviations, 
Attitude Scales, Experiment 1 







Liking 


or Math 


Class 


5€ 




JttLC \J L -L. 1 i 


Math 






Pre 


Post 


Adjusted 


Pre 


I U o L 


AH t i 1 t" P H 


TAI 


— 

X 


25 . 15 


25 . 16 


•24. 


67 


24. 


10 






s 


J . 3D 


•4 . / O 


4. 


06 


L . 


65 


4 . 11 


3.35 




N , 




120 










117 




AGAT 


X 


24; 99 


24.48 


24. 


06 


24. 


15 


23.31 


22.98 


s 


5.04 


4.90 


4. 


41 


4. 


12 


4.44 


3.57 




N 




86 










80 




MMP 


X 


22,71 


21.65 


22. 


35 


22. 


86 


22.68-- 


^23.13 


s 


5.96 


6.01 


5. 


42 


4. 


66 


"5 .10 


4.09 




N 




135 










139 




TOTAL 


X 


24.14 


23.60 


23. 


60 


23. 


60 


23.64 


23.64 


s 


5.63 


5.55 


4. 


83 


4. 


56 


4.72 


3.80 




N 




341 










336 





Note: Table entries are raw scores from 8-item attitude scales. Range 

of possible scores: 8-32. Adjusted scores are posttests adjusted 
for pretests. 
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Table 4 



Results of Nested Analyses of Variance, 
Adjusted Attitude Scales; Experiment 1 



Source of 
Variation 

Treatment 

Class/Teacher 
Within Treatment 

Error (within 
cells) 



liking of Hath Class 
d.f. M.S.__ J _p_£ 

2 183.74 4.06 .043 



13 45.28 2.11 .013 



325 21.43 



Differences between Adjusted "Means 
in Effect Sizes, liking of Hath Glass 



TAI 



TA'I 



AGAT 



MMP 



AGAT 



+.13 



+.48*** 



+.35*** 



p ^ .01 Using Modified Bonferroni Procedure 
p K .001 Using Modified Bonferroni Procedure 



Self-Concept in Math 
d.f. M.S. F 



2 101.86 4.15 



13 



320 



24.52 



13.45 



1.82 



Differences between Adjust 
in Effect Sizes, Self-Con- 



TAI 



AGAT 



TAI 

AGAT 

MMP 



+.45*** 
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Table 5 



Means and Standard beviatiohs in T-Scores^ 
and Grade Equivalents, Mathematics Achievement Measures * Experiment 2 



Coapn tat ions 
GAT (Pre) CTBS (Post) Adjusted 



Concept 



Applications 



GAT (Pre )- CTBS (Post) Adjusted 



TAI 



AGAT 



MMP 



CONTROL 



TOTAL 



T 
S 

G.E. 
S 
N 

T 

S 

G.E. 
S 
N 

T 
S 

G.E. 

S 
N 

T 
S 

G.E. 

S 
N 

T 
S 

G.E. 
S 
N 



51.35 
(9.05) 
4.64 
(0.79) 



53.16 
(8.81) 
4.79 
(0.77) 



49.84 
(10.76) 
4.51 
(0.94) 



45.91 
(9.41) 
4.16 
(0.32) 



50.00 
(10.00) 
4.52 
(0.87) 



52.92 
(9.64) 

6.31 
(1.51) 

112 

54.99 
(10.12) 

6.63 
(1.58) 

98 

48.80 
(8.24) 

5.66 
(1.29) 

162 

44.15 
(9.29) 

4.94 
(1.45) 

106 

50.00 
(10.00) 
5.85 
(1.56) 
478 



51.83 
(7.94) 
6. 14 
(1.24) 



53.49 
(8.58) 
6;40 
(1.34) 



48.92 
(7.54) 
5.68 
(1.18) 



46.49 
(7.97) 
5.30 
(1.25) 



50;00 
(8;32) 
5.85 
(1.30) 



52.21 
(8.96) 
5.36 
(1.16) 



55.40 
(10.46) 
5.77 
(1.35) 



48.19 
(8.91) 
4.84 
(1.15) 



45.39 
(9.27) 
4.48 
(1.'20) 



50.00 
(10.00) 
5.07 
(1.29) 



51.07 
(9.15) 

6.03 
(1.62) 

114 

57.05 
(9.90) 

7.09 
(1.76) 

98 

47.92 
(9.10) 

5.47 
(1.61) 

162 

•45.51 
(8.48) 

5.05 
(1.50) 

106 

50.00 
(10.00) 

5.84 
(1.77) 

480 



49.27 
(7.13) 
5.71 
(1.27) 



53.31 
(7.26) 
6.43 
(1.29) 



49.21 
(6.55) 
5.70 ' 
(1.16) 



48.93 
(6.01) 
5.65 
(1.07) 



50.00 
(6.92) 
5.84 
(1.23) 



Note . Table entries are T scores (Mean-50, S .D.=10) computed separately f 
each grade level. Adjusted scores are CTBS (Post) scores adjusted 
CAT (Pre) scores separately for each grade level. 
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Table 6 

Results of Nested Analyses of Variance, Adjusted 
Mathematics Achievement, Experiment 2 



Source of 
Variation 

Treatment 

Class/Teacher 
Within Treatment 

Error (within 
cells) 





Compu tations 




Concepts and i 


applications 






_JL< 
.076 


d.F. 


M.S. 




3 


10.22 2.71 


3 


4.52 


1.94 n.s. 


18 


3.78 7.43 


.001 


18 


2.33 


6.16 .001 


456 


0.51 




458 


0.38 





Differences between Adjusted Means in 

Effect Sizes and (Grade Equivalents) , Computations 



TAI 



AGAT 



MR? 



CONTROL 



TAI 



-.20 +.35** + .64*** 

(-.26) (+.46) (+ .84) 



AGAT 



+.55*** + .84*** 
(+. 72) (+1.10) 



MMP 



+ .29* 
(+ .38) 



CONTROL 



><.05 using Modified Bonferroni Procedure 
p< iOi us ing Modified Bonferroni Procedure 
P<C.001 using Modified Bonferroni Procedure 
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Table -7 



Means and Standard Deviations * 
Attitude Scales, Experiment 2 



Self- 







rre 


rOSl 




Pre 


Post 


Adjusted 


TAI 




24. 61 


26.46 


26.90 


24.71 


24.50 


24; 24 


s 


5.91 


4.93 


4.51 


4.60 


4.67 


4.04 




N 




DC 






96 






~Sr 
*\ 


?fi (17 ■ 


24.76 


24 .30 


25.07 


24.83 


24.36 


S 


4.77 


5.34 


4.45 


4.58 


4.52 


3.55 




N 




90 






89 






X 


25-S6 


25.33 


25.24 


23.84 


24.56 


24.81 


s 


4.85 


5.4.4 


4.49 


4.64 


4.80 


3.81 




N 




153 






157 




Control 


X 


25-07 


22.81 


22.97 


23.78 


24.88 


25.17 


s 


5,99 


6.63 


4.54 


4.57 


4.29 


3.40 




N 




86 






93 




TOTAL 


X 


25.32 


24.95 


24.95 


24.27 


24.67 


24.67 


s 


5-33 


5.69 


4.67 


4.62 


4.60 


3.73 




N 




424 






435 





Note: Table entries are raw scores from 8-item attitude scales. Range 

of possible scores: 8-32. Adjusted scores are posttests adjusted 
for pretests. 
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Table 8 

Results of Nested Analyses of Variance; 
Adjusted Attitude Scales, Experiment 2 



P < .01 Using Modified Bonferroni Procedure 

ick - — - 

p < ,001 Using Modified Bonferroni Procedure 



Source of Liking of Hath Class Self-Concept in Math 

Variation d.f. M T S . -3- . -£< d . f . M . S . 

rreatment 3 249.70 5.41 .008 3 17.38 0.52 



-lass/Teacher 

Within Treatment 18 46.17 2.42 .001 18 33-38 2.56 
Srror. (within 

:ells) 402 19.04 413 13.03 



)ifferences between Adjusted Means 
.ft Effect Sizes, Liking, of Math Class 

TAI AGAT - MMP CONTROL 

AI — +.56*** +.36** +.84*** 

— -.20 +.28 

MP •- — +.49*** 

0NTR0L 
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